🕷️️ Job Radar • SCRAPING

upwork.com 🟢 2026-05-22

🔹 Scalable Pricing Intelligence & Market Monitoring System
👤 Client: 🇺🇸 United States Member since 2024-09-11
💰 Price: ****
🚩 Problem: Lack of standardized, automated competitive pricing data from multiple online sources for market analysis.
📦 Existing: Internal matching identifiers

Specifications:

[Target] Publicly available product and pricing information
[Target] Provider/vendor names, travel duration, traveler count, accommodation/vehicle categories, add-ons, departure dates
[Method] Web scraping, data mining, browser automation
[Method] Scheduled ETL pipelines (Daily)
[Method] Data normalization and attribute mapping
[Stack] Snowflake or similar data warehouse
[Stack] Cloud-based data infrastructure
[Format] Structured tabular datasets
[Format] One record per pricing result
[Security] Monitoring, logging, and data quality validation

Workflow:

1. Extraction of raw product and pricing data from target platforms.
2. Normalization and mapping of attributes using internal identifiers.
3. Execution of scheduled ETL pipelines for data cleaning.
4. Integration of structured datasets into Snowflake/Cloud warehouse.